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Conditions quadratiques pour des extremales 
bang-singulieres 

Resume : Dans ce travail nous etudions le probleme de commande optimale avec des controles 
affines dans la dynamique. On considere des contraintes de non-negativite sur la commande et une 
quantite finie de contraintes d'egalite et d'inegalite sur la valeur finale de I'etat. Premierement 
on obtient des conditions necessaires d'optimalite de second ordre. Ensuite, on presente une 
condition suffisante pour le cas d'une commande scalaire. 

Mots-cles : Commande optimale, conditions du second ordre, contraintes sur la commande, 
arc singulier, solutions bang-singulieres, SADCO. 
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1 Introduction 

In this article we obtain second order conditions for an optimal control problem affine in the 
control. First we consider a pointwise nonnegativity constraint on the control, end-point state 
constraints and a fixed time interval. Then we extend the result to bound constraints on the 
control, initial-final state constraints and problems involving parameters. We do not assume that 
the multipliers are unique. We study weak and Pontryagin minima. 

There is already an important literature on this subject. The case without control constraints, 
i.e. when the extremal is totally singular, has been extensively studied since the mid f960s. 
Kelley in [32] treated the scalar control case and presented a necessary condition involving the 
second order derivative of the switching function. The result was extended by Kopp and Moyer 
[M] for higher order derivatives, and in [22 it was shown that the order had to be even. Goh 
in |27| proposed a special change of variables obtained via a linear ODE and in |26| used this 
transformation to derive a necessary condition for the vector control problem. An extensive 
survey of these articles can be found in Gabasov and Kirillova [53]. Jacobson and Speyer in 
[3D], and together with Lele in |31| obtained necessary conditions by adding a penalization term 
to the cost functional. Gabasov and Kirillova [53], Krener [3S], Agrachev and Ganikrelidze [T] 
obtained a countable series of necessary conditions that in fact use the idea behind the Goh 
transformation. Milyutin in |43j discovered an abstract essence of this approach and obtained 
even stronger necessary conditions. In |2] Agrachev and Sachkov investigated second order 
optimality conditions of the minimum time problem of a single- input system. The main feature of 
this kind of problem, where the control enters linearly, is that the corresponding second variation 
does not contain the Legendre term, so the methods of the classical calculus of variations are 
not applicable for obtaining sufficient conditions. This is why the literature was mostly devoted 
to necessary conditions, which are actually a consequence of the nonnegativity of the second 
variation. A sufficient condition for time optimality was given by Moyer |45] for a system with 
a scalar control variable and fixed endpoints. On the other hand, Goh's transformation above- 
mentioned allows one to convert the second variation into another functional that hopefully turns 
out to be coercive with respect to the L2~iiorm of some state variable. Dmitruk in |12| proved 
that this coercivity is a sufficient condition for the weak optimality, and presented a closely 
related necessary condition. He used the abstract approach developed by Levitin, Milyutin and 
Osmolovskii in [35], and considered finitely many inequality and equality constraints on the 
endpoints and the possible existence of several multipliers. In [T31[T5] he also obtained necessary 
and sufficient conditions for this norm, again closely related, for Pontryagin minimality. More 
recently, Bonnard et al. in [5] provided second order sufficient conditions for the minimum time 
problem of a single-input system in terms of the existence of a conjugate time. 

On the other hand, the case with linear control constraints and a "purely" bang-bang control 
without singular subarcs has been extensively investigated over the past 15 years. Milyutin and 
Osmolovskii in [33] provided necessary and sufficient conditions based on the general theory of 
[35]. Osmolovskii in [15] completed some of the proofs of the latter article. Sarychev in [53] gave 
first and second order sufficient condition for Pontryagin solutions. Agrachev, Stefani, Zezza [3] 
reduced the problem to a finite dimensional problem with the switching instants as variables 
and obtained a sufficient condition for strong optimality. The result was recently extended by 
Poggiolini and Spadini in [37]. On the other hand, Maurer and Osmolovskii in [311 |3I] gave 
a second order sufficient condition that is suitable for practical verifications and presented a 
numerical procedure that allows to verify the positivity of certain quadratic forms. Felgenhauer 
in [511 [551 [53] studied both second order optimality conditions and sensitivity of the optimal 
solution. 

The mixed case, where the control is partly bang-bang, partly singular was studied in |48] 
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by Poggiolini and Stefani. They obtained a second order sufficient condition with an additional 
geometrical hypothesis (which is not needed here) and claimed that it is not clear whether 
this hypothesis is 'almost necessary', in the sense that it is not obtained straightforward from 
a necessary condition by strengthening an inequality. In |491 I50j they derived a second order 
sufficient condition for the special case of a time-optimal problem. The main result of the present 
article is to provide a sufficient condition that is 'almost necessary' for bang-singular extremals 
in a general Mayer problem. 

On the other hand, the single-input time-optimal problem was extensively studied by means 
of and synthesis-like methods. See, among others, Sussmann [SHI [SSI \57\, Schattler [M] and 
Schattler-Jankovic |33]. Both bang-bang and bang-singular structures were analysed in these 
works. 

The article is organized as follows. In the second section we present the problem and give 
basic definitions. In the third section we perform a second order analysis. More precisely, we 
obtain the second variation of the Lagrangian functions and a necessary condition. Afterwards, 
in the fourth section, we present the Goh transformation and a new necessary condition in the 
transformed variables. In the fifth section we show a sufficient condition for scalar control. 
Finally, we give an example with a scalar control where the second order sufficient condition can 
be verified. The appendix is devoted to a series of technical properties that are used to prove 
the main results. 

2 Statement of the problem and assumptions 

2.1 Statement of the problem 

Consider the spaces U := Loo(0,T;R™) and X := iy^(0,T;R") as control and state spaces, 
respectively. Denote with u and x their elements, respectively. When needed, put w = (a;, u) for 
a point m W :^ X X U . In this paper we investigate the optimal control problem 



J := ipoix{T)) ^min. 




(2.1) 


i{t) = ) 'uj^ix), x(0) =2:0, 

i—0 




(2.2) 


u{t) > 0, a.e. on t e [0,r], 




(2.3) 


^^{x{T))<0, forj = l,...,d^, v^i^T))-- 


= 0, for j = l...,djj. 


(2.4) 


> R" for i =: 0, . . . , m, V3, : M" ^ M for i = 0, . 


..,dy, r/j :M" ^ R for j = 1, 


. . . , d^ 



where fi : M 

and Mo = 1. Assume that data functions fi are twice continuously differentiable. Functions ipi 

and rjj are assumed to be twice differentiable. 

A trajectory is an element w £ W that satisfies the state equation (|2.2p . If, in addition, 
constraints (|2.3p and (|2.4p hold, we say that w is a feasible point of the problem (|2.ip - (|2.4p . 
Denote by A the set of feasible points. A feasible variation for w £ A is an element 6w G W 
such that w + Sw G A. 

Definition 2.1. A pair w'^ — (x'^.u'^) £W is said to be a weak minimum of problem (j2.ip - (|2.4p 
if there exists an e > such that the cost function attains at w° its minimum on the set 

{w = {x,u) e A : \\x — a;"||oo < £, \\u — u"||oo < e} • 

We say w'^ is a Pontryagin minimum of problem (j2.ip - (|2.4p if for any positive N, there exists 
an En > such that w" is a minimum point on the set 

{w^ {x,u) e A: ||a::-a;"||oo < e^v, ||w - u°||oo < A^, ||u - ^"111 < En} ■ 
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Consider A = (a, ^,7/-) £ R'^'p+^^* x R'''"* x VF^(0,T;M"'*), i.e. ^ is a Lipschitz-continuous 
function with values in the n— dimensional space of row- vectors with real components R"'* . Define 
the pre-Hamiltonian function 



H[X\{x, u, t) := tp{t) ^ Uifi{x), 



^[X]iw) := i[X]ixiT)) + / m (j2^.it)Mx{t)) - x{t) At. (2.5) 



i=0 

the terminal Lagrangian function 

4A](<7) :- £a,^.(g) +^ft-r?,(g), 

i=0 j=l 

and the Lagrangian function 

/o 

In this article the optimality of a given feasible trajectory w = {x,u) is studied. Whenever 
some argument of fi, H, i, $ or their derivatives is omitted, assume that they are evaluated over 
this trajectory. Without loss of generality suppose that 

(p^{x{T)) = 0, for alH = 0, 1, . . . , d^. (2.6) 

2.2 First order analysis 

Definition 2.2. Denote by A C R'''^+^'*xR'''"*x W4,(0,r;R"'*) the set of Pontryagin multipliers 
associated with w consisting of the elements A = (a, /?, ip) satisfying the Pontryagin Maximum 
Principle, i.e. having the following properties: 

|a| + |/3| = l, (2.7) 

a = {ao,ai,...,ad^)>0, (2.8) 

function ip is solution of the costate equation and satisfies the transversality condition at the 
endpoint T, i.e. 

-m=.H.AX\ixit),u{t),t), ^(r)-£'[A](£(r)), (2.9) 

and the following minimum condition holds 

H[X]{x{t),ii{t),t)=mmH[X]{x{t),v,t), a.e. on[0,r]. (2.10) 

Remark 2.3. For every A G A, the following two conditions hold. 

(i) Hui [A] is continuous in time, 

(a) HuAM{t) > 0, a.e. on [0,T]. 

Recall the following well known result for which a proof can be found e.g. in Alekseev and 
Tikhomirov 0], Kurcyusz and Zowe |36j . 

Theorem 2.4. The set A is not empty. 
RR n° 7664 
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Remark 2.5. Since ip may be expressed as a linear continuous mapping of{a,l3) and since (j2.7p 
holds, A is a finite- dimensional compact set. Thus, it can be identified with a compact subset of 
R^, where s :— d^p + d^/ + I. 

The following expression for the derivative of the Lagrangian function holds 

<^uMw)v= f H^[X]ixit),u{t),t)v{t)dt. (2.11) 



(2.12) 



Consider v Cz U and the linearized state equation: 

m 771 

m = Y, u,{t)fl{x(t))z{t) + Y, v^{t)f,{u{t)), a.e. on [0, T], 

7 = 7=1 

[ z(0)-0. 

Its solution z is called the linearized state variable. 
With each index i = 1, . . . , to, we associate the sets 

To ■■= it e [0,T] : maxHuAm) > o| , /; := [0,r]\/^, (2.13) 

and the active set 

r„:^{te[0,T]:u,it)=0}. (2.14) 

Notice that /q C Tq, and that /q is relatively open in [0,r] as each i?uJA] is continuous. 
Assumption 1. Assume .strict complementarity for the control constraint, i.e. for every i = 
l,...,m, 

/q = /q, up to a set of null measure. (2-15) 

Observe then that for any index i ~ 1, ... ,771, the control Ui(fy > a.e. on /^, and given 
Ae A, 

H„JA](t) =0, a.e. on/;. 

Assumption 2. For every i = 1, . . . , m, the active set /q is a finite union of intervals, i.e. 

for /j subintervals of [0,T] of the form [0,(i), {c,T\\ or (c, d) if c 7^ and d =^ T. Denote by 
c\ < d[ < C2 < . ■ . < c]y. < d]y. the endpoints of these intervals. Consequently, /^ is a finite 
union of intervals as well. 

Remark 2.6 (On the multi-dimensional control case). We would like to make a comment con- 
cerning solutions with more than one control component being singular at the same time. In 
/PI \1(J^ . Chitour et al. proved that generic systems with three or more control variables, or with 
two controls and drift did not admit singular optimal trajectories (by means of Goh's necessary 
condition JESS)- Consequently, the study of generic properties of control-affine systems is re- 
stricted to problems having either one dimensional control or two control variables and no drift. 
Nevertheless, there are motivations for investigating problems with an arbitrary number of inputs 
that we point out next. In ]87j . Ledzewicz and Schdttler worked on a model of cancer treatment 
having two control variables entering linearly in the pre-Hamiltonian and nonzero drift. They pro- 
vided necessary optimality conditions for solutions with both controls being singular at the same 
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time. Even if they were not able to give a proof of optimality they claimed to have strong expec- 
tations that this structure is part of the solution. Other examples can be found in the literature. 
Maurer in fj^ analyzed a resource allocation problem (taken from Bryson-Ho JSJl). The model 
had two controls and drift, and numerical computations yielded a candidate solution containing 
two simultaneous singular arcs. For a system with a similar structure, Gajardo et al. in \25^ 
discussed the optimality of an extremal with two singular control components at the same time. 
Another motivation that we would like to point out is the technique used in Aronna et al. J^ to 
study the shooting algorithm for bang-singular solutions. In order to treat this kind of extremals, 
they perform a transformation that yields a new system and an associated totally singular solu- 
tion. This new system involves as many control variables as singular arcs of the original solution. 
Hence, even a one- dimensional problem can lead to a multi- dimensional totally singular solution. 
These facts give a motivation for the investigation of multi-input control- affine problems. 

2.3 Critical cones 

Let 1 < p < oo, and call Up := Lp(0, T; M™), U+ := Lp(0, T; M™) and Xp := W^{0, T; R"). Recall 
that given a topological vector space E, a subset D C E and x € E, a. tangent direction to D at 
a; is an element d G E such that there exists sequences (crfe) C IR+ and (xk) C D with 

Xk-X 

> d. 

It is a well known result, see e.g. [TT], that the tangent cone to U2 at u is 

{v GU2 : Vi > on Iq, for i = 1, . . . , m}. 

Given v G Up and z the solution of (|2.12p . consider the linearization of the cost and final 
constraints 

(ip'MT))z{T)<0, t^O,...,d^, 

\rj'^{x{T))z{T) = 0, j^l,...,d^. 

For p S {2,cxj}, define the Lp— critical cone as 

Cp-.^ {{z,v) eXpXUp-.v tangent to U+ , ((TT^ and (^1^ hold} . 

Certain relations of inclusion and density between some approximate critical cones are needed. 
Given e > and i ~ 1, . . . ,m, define the e— active sets, up to a set of null measure 

Il:^{te{0,T):u,{t)<e}, 

and the sets 

Wp^e ■■= {{z, v) eXpXUp-.v.^O on /*, ((TT2)) holds}. 

By Assumption 1, the following explicit expression for C2 holds 

C2 - {{z, v) e W2,o : (EUD holds}. (2.17) 

Consider the e— critical cones 

Cp^^ := {(z, v) e Wp,e : d^l^ holds}. (2.18) 

Let £ > 0. Note that by (j2.17p . €2,5 C €2- On the other hand, given (z, v) G Coo,e, it easily follows 
that u -\- av Cz U^ for small positive a. Thus v is tangent to U^ at it, and this yields Coo,e C Coo- 

Recall the following technical result, see Dmitruk |16| . 
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Lemma 2.7 (on density). Consider a locally convex topological space X, a finite-faced cone 
C d X, and a linear manifold L dense in X. Then the cone C (1 L is dense in C. 

Lemma 2.8. Given e > the following properties hold. 

(a) Cao.e C C2,£ with dense inclusion. 

(h) lJe>o'^2,e C C2 with dense inclusion. 

Proof, (a) The inclusion is immediate. As U is dense in U2, Woo,e is a dense subspace of W2,e- 
By Lemma [2771 C2,e H Woo.e is dense in C2,e, as desired. 

(b) The inclusion is immediate. In order to prove density, consider the following dense subspace 
of yV2fi ■■ 

W2,u := U W2,s, 

and the finite-faced cone in C2 C W2.o- By Lemma [2.71 C2 H W2,|j is dense in C2, which is what 
we needed to prove. D 

3 Second order analysis 
3.1 Second variation 

Consider the following quadratic mapping on W; 

n[\]{5x,5u) ■.=\e'[X]{x{T))[5x{T)f 

+ h I [{H,^[X]5x, 5x) + 2{H^^[X]5x, 5u)] dt. 
Jo 

The next lemma provides a second order expansion for the Lagrangian function involving operator 
rj. Recall the following notation: given two functions h : R" — >■ R"*" and k : R" — >■ R"*", we say 
that ft, is a big-0 of k around and denote it by 

h{x) = 0{k{x)), 

if there exists positive constants 6 and AI such that |/i(a;)| < M|/c(a;)| for |a;| < S. It is a small-o 
if M goes to as I a; I goes to 0. Denote this by 

h{x) = o(k{x)). 

Lemma 3.1. Let Sw ~ {Sx,5u) e W. Then for every multiplier A G A, the function $ has the 
following expansion (omitting time arguments): 

'i'[X]{w + 6w)^ I Hu[X]Sudt + n[X]{5x,5u) + ^ I {Huxx[X]dx,dx,6u)dt 
Jo Jo 

+ 0{\Sx{T)\^)+ f \{u + Su){t)\0{\Sx{t)\^)dt. 
Jo 

Proof. Omit the dependence on A for the sake of simplicity. Use the Taylor expansions 
i{x{T) + 6x{T)) = i{x{T)) + e'{x{T))Sx{T) + \e'{x{T)){5x{T)f + 0{\5x{T)\''), 

f,{x{t) + 5x{t)) = f,{x{t)) + immm + ynm){5<t)f + od-^x^n, 
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in the expression 



$(w + 6w) = £{x + dx{T)) + f ip 



y^{ui + 6ui)fi{x + Sx) — X — Sx 



dt. 



.i=0 

Afterwards, use the identity 

/ iJy2i^^f■{x)5xdt=-e'{x{T))6x{T)+ #xdi, 
Jo i^Q Jo 

obtained by integration by parts and equation (|2.2p to get the desired result. D 

The previous lemma yields the following identity for every (dx,du) € W : 

n[\]{6x,du) = ^D^'^[X]{w){Sx,Suf. 

3.2 Necessary condition 

This section provides the following second order necessary condition in terms of 17 and the critical 
cone C2. 

Theorem 3.2. If w is a weak minimum then 

maxl7[A](z,u) > 0, for all (z,i;) G C2. (3.1) 

AgA 



]}d 



For the sake of simplicity, define ip -.U ^ R'*»'+^, and 77 : U 

Cpi{u) := ipi{x{T)), for i = 0, 1, . . . , d^, 
f]j{u) := T]j{x{T)), for j = 1, . . . ,d^. 



" as 



(3.2) 

J J^j • • • J "rjj 

where a: is the solution of (|2.2p corresponding to u. 

Definition 3.3. We say that the equality constraints are nondegenerate if 

f]'{u) is onto from U toM'^". (3.3) 

// p.3p does not hold, we call them degenerate. 

Write the problem in the following way 

(Pq{u) -^ min; (pi{u) < 0, i^l,. ..,d^, fi{u) = 0, w G U+. (P) 

Suppose that it is a local weak solution of ([P|). Next we prove Theorem 13.21 Its proof 
is divided into two cases: degenerate and nondegenerate equality constraints. For the first case 
the result is immediate and is tackled in the next Lemma. In order to show Theorem l3.2l for the 
latter case we introduce an auxiliary problem parameterized by certain critical directions (z,^), 
denoted by ( |QPt,[ ). We prove that val( |QPt,| > and, by a result on duality, the desired second 
order condition will be derived. 

Lemma 3.4. // equality constraints are degenerate, then (j3.ip holds. 
RR n° 7664 
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Proof. Notice that there exists /3 7^ such that J2i=i (^jVii^iT)) = 0, since r]'{u) is not onto. 
Consider a = and ip = 0. Take A := (a, /3, ip) and notice that both A and —A are in A. Observe 
that 

t7[A](z,«) = i^/3,r;;'(x(T))(z(T))2. 

Thus J7[A](z, w) > either for A or —A. The required result fohows. D 

Take e > 0, {z,v) £ Coo.e, and rewrite (|2.18p using the notation in p.2p . 

Coo.e = {iz,v) £ X xU : Vj(t) = on /^, i = 1,. . . ,m, 

(Pl^ holds, 'f',iu)v < 0, i = 0,...,d^, fj'{u)v = 0}. 



Consider the problem 



S^ — > min 

<:p'^{u)r + (f'f{u){v,v) < SC, for i = 0, ...,d^, 
fj'{u)r + fj"{u){v, v) = 0, 
— fi{t) < <^Ci on Iq, for z = 1, . . . ,m. 



(QP.) 



Proposition 3.5. Let {z,v) e Cco.s- If the equality constraints are nondegenerate, problem ( |QPi,[ ) 
is feasible and val ( |QPt,[ ) > 0. 

Proof. Let us first prove feasibility. As 'fj'{u) is onto, there exists r £ U such that the equality 
constraint in ([QP7| is satisfied. Take 

6( := v[Yax{\\r\\ryo,Cp[{u)r + (p" {u){v,v)). 



Thus the pair (r, 5C,) is feasible for ( 
Let us now prove that val ([QP^ 



og. 



> 0. On the contrary suppose that there exists a feasible 



solution (r, 5C,) with (5C < 0. The last constraint in ( |QP„[ ) implies ||r||oo 7^ 0. Set, for cr > 0, 

u{(j):=u + cfv + \a'^r, C,{a) -.^ \a^5C,. (3.4) 

The goal is finding u{a) feasible for ([P]) such that for small cr, 

u{<j) — > ii, and (f^{u{cr)) < (pq{u), 

contradicting the weak optimality of u. 

Notice that Ui{t) > e a.e. on [0,r]\/*, and then ■u{a)i{t) > —({(t) for sufficiently small a. On 
II, ii u{(T)i{t) < — C(c) then necessarily 

Mt)<h'^''{\\r\\oo + \SC\), 
as Vi{t) = 0. Thus, defining the set 

jy.^{t:o<Mt)<h'^\\\r\\^ + m)}, 

we get {t £ [0, T] : u{a)i{t) < -C(ct)} C J^. Observe that on J* , the function \u{a)i{t) + C{a)\/a^ 
is dominated by ||r||oo + \SC\- Since mcas( J^) goes to by the Dominated Convergence Theorem, 
we obtain 

|w(a),(t) + C>)|dt = o(a2). 
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Take 

"^"^ ^ 1 -C» on J^ 
Thus, u satisfies 

u{a){t) > -Cia), a.e. on[0,r], (3.5) 

\\u{a) -u\\i = o(ct^), ||{t(cr) - u||oo = 0(o-^), 
and the following estimates hold 



f^{u{(J)) = f,{u) + <T'p[{u)v + ^a'^[ip'i{u)r + ip'-{u){v, v)] + o(cr2) 



<(^,(u) + CM + o(a"), 
f]{u{cr)) = cr77'(u)i) + iCT^[77'('u)r + ^"(M)(w,i;)] + o(cr^) = o(cr^). 



(3.6) 



As fj'{u) is onto on Z// we can find a corrected control u((t) satisfying the equality constraint and 
such that \\u{a) - u(cr)||oo = o{ct'^). Deduce by (|53|) that u{a) > a.e. on [0,r], and by (j?^ 
that it satisfies the terminal inequality constraints. Thus u{a) is feasible for (jPj and it satisfies 
This contradicts the weak optimality of u. D 



Recall that a Lagrange multiplier associated with lu is a pair (A, fi) in ]R''»'+^ x R**'' x 
M^i(0,r;R"^*)xZ^* withA = (a, /3» satisfying ((121), ([MD, /i > und the stationarity condition 

Hu[X]{t)v{t)dt + / u(t)d/i(t) = 0, for every v eU. 
10 Jo 

Here U* denotes the dual space of U. Simple computations show that (A,/i) is a Lagrange 

multiplier if and only if A is a Pontryagin multiplier and /i = Hu[X]. Thus /i e Loo(0,r;M'"'*). 

Let us come back to Theorem [ 



Proof, [of Theorem 13. 2| Lemma [3^ covers the degenerate case. Assume thus that fj'{u) is onto. 
Take e > and {z,v) € Coo,e- Applying Proposition 13. 5| we see that there cannot exist r and 
(5C < such that 

Cp'i{u)r + (p'l{u){v, v) <SC, i = 0,..., d^, 

f]'{u)r + fi"{u){v,v) ~ 0, 

— ri{t) < 5C, on /q, for i = 1, . . . , m. 

By the Dubovitskii-Milyutin Theorem (see [T2]) we obtain the existence of (a, (3) E W and 
^ eU* with supp ^i C /q, and (a, f3,fi)^0 such that 

J2a,^',{u)+Y,M',iu)-t^ = 0, (3.7) 

i=0 i=l 

and denoting A :— {a,P,ip), with ip being solution of (j2.9p . the following holds: 

i=0 i=l 

By Lemma l8T2l we obtain 

n[X]{z,v)>0. (3.8) 

Observe that (|3.7p implies that A G A. Consider now {z,v) G C2, and note that Lemma 12.81 
guarantees the existence of a sequence {(z^jVe)} C Coc,e converging to (z,w) in X2 x U2- Recall 
Remark l2.5l Let A^ g A be such that p.8p holds for (A^, z^, v^). Since (A^) is bounded, it contains 
a limit point A e A. Thus p.8p holds for (A, z, v), as required. D 
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4 Goh Transformation 

Consider an arbitrary linear system: 

z{t) = A{t)z{t) + B{t)v{t), a.c. on [0, T], 



m = 0, (4.1) 

where A{t) € /:(R";]R") is an essentially bounded function of t, and B{t) € £(M™;M") is a 
Lipschitz-continuous function of t. With each v ^ U associate the state variable z G X solution 
of (|2.12p . Let us present a transformation of the variables {z,v) E W, first introduced by Goh 
in [27]. Define two new state variables as follows: 

y(t) :— / w(s)ds, 

"^' Jo (4.2) 

m -.^ zit) - B{t)y{t). 

Thus y ey := W^{0,T;R"^), y{0) = and ^ is an element of space X. It easily follows that ^ 
is a solution of the linear differential equation 

i{t)=A{t)m+Biit)yit), m = 0, (4.3) 

where 

Biit) ~ Ait)Bit) - Bit). (4.4) 

For the purposes of this article take 

m m 

A{t) ■.^Y.^Jldd)), and B{t)v{t) := ^ «,(f)/,({*(t)). (4.5) 

i=0 1=1 

Then (|4.ip coincides with the linearized equation (|2.12p . 

4.1 Transformed critical directions 

As optimality conditions on the variables obtained by the Goh Transformation will be derived, 
a new set of critical directions is needed. Take a point {z,v) in Coo, and define ^ and y by 
the transformation (|4.2p . Let h :— y{T) and notice that since (|2.16p is satisfied, the following 
inequalities hold, 



(4.6) 



^'MTMiT) + B{T)h) < 0, for z = 0, . . . , d^, 
77^.(x(T))(e(r) + B{T)h) = 0, for j = 1, . . . , d„. 

Define the set of transformed critical directions 

^,^{[Lv,h)GXxyx R" : y, = over I^ y(0) = 0, /i := y(T),l 
\ gSl) and (gH) hold J ■ 

Observe that for every (^, y,h) Cz V and 1 < J < m, 

yi is constant over each connected component of /q, (4.7) 

and at the endpoints the following conditions hold 

y, = 0on [0,di), if £ /^, and 
y, = /i, on(civ.,T], if T e /^, 



(4.8) 



Inria 
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where c\ and d\ were introduced in Assumption 2. Define the set 

V2 := {(e, y, h)eX2xU2X K™ : g31), gH), gJl) and gj) hold} . 
Lemma 4.1. V is a dense subset ofV2 in the X2 x U2 x W"'- — topology. 
Proof. The inclusion is immediate. In order to prove the density, consider the following sets. 
X := {(e,2/, h)eX2xU2X M" : gS]), Ql^, and (gSD hold}, 

L := {(e, y, y(r)) e <Y X 3; X R" : y(0) = 0, g^]) and gj]) hold}, 

C := {(C, y,h)eX : ^Ml holds} . 

By Lemma 18.11 L is a dense subset of X. The conclusion follows with Lemma 12.71 D 

4.2 Transformed second variation 

We are interested in writing Q in terms of variables y and S, defined in (|4.2p . Introduce the 
following notation for the sake of simplifying the presentation. 

Definition 4.2. Consider the following matrices of sizes n x n,m X n and m X n, respectively. 
Q[X] := H.^AM, C[X] := H^^X], M[X] -.^ B^Q[X] ~ C[X] - C[X]A, (4.9) 



where A and B were defined in (|4.5p . Notice that M is well-defined as C is Lipschitz- continuous 
on t. Decompose matrix C[A]-B into its symmetric and skew- symmetric parts, i.e. consider 

S[X] :- \{C[X]B + (C[A]i?)^), V[X] := \{C[X]B - {C[X]B)'). (4.10) 

Remark 4.3. Observe that, since C[A] and B are Lipschitz- continuous, S[X] and V[X] are 
Lipschitz-continuous as well. In fact, simple computations yield 

S^A^] = ^Hflfj + /;/0, V,,[X] = ^m, fjl for z, J = 1, . . . , m, (4.11) 

where 

[hJ^^^nij-fjh- (4.12) 

With this notation, O takes the form 

n[X]{5x,v) = \f[X]{x{T)){5x{T)f + l [ [iQ[X]6x,Sx) -{• 2{C[X]Sx,v)]dt. 

Jo 

Define the m x m matrix 

R[X] := B^Q[X]B - C[X]Bi - {C[X]Bi)^ - S[X], (4.13) 

where Bi was introduced in equation (|4.4p . Consider the function ^[A] from M" x R™ to R defined 
by: 

5[A](C, h) := i£"[A](x(T))(C + B{T)hf + i(C[A](r)(2C + B{T)h),K). (4.14) 

Remark 4.4. (i) We use the same notation for the matrices Q[A], C[A], M[A], i"{X\{x{T)) 
and for the bilinear mapping they define. 

(ii) Observe that when m ^ 1, the function V[X] =0 since it becomes a skew- symmetric scalar. 
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Definition 4.5. Define the mapping over X x y x U given by 

n-pm^,y,v):=g[XmT),yiT)) 

i-T (4.15) 

+ / {\{Q[\%0 + '2{M[\%y) + },{R[\]y,y) + {V[\]y,v)}At, 
Jo 

withg[X], Q[X], M[\], R[X] andV[X] defined in ((4J)) - (|4l4)) . 

The following theorem shows that fip coincides with fl. See e.g. |15) . 
Theorem 4.6. Let {z,v) G W satisfying I^J^ and {^,y) be defined by (|i?^ . Then 

n[X]{z,v)^nr[X]{ty,v). 

Proof. We omit the dependence on A for the sake of simplicity. Replace z by its expression in 
((0)1 and obtain 



h I [(Q(C + By), £. + By) + {C{^ + By),v) + {C'^v, S, + By)]dt. 



2 
JO 



(4.16) 



Integrating by parts yields 



(Cf , v)At = [(CC, y)]l -I (Ce + C{Ai + Siy), y)At, (4.17) 

"'0 



and 



{CBy,v)At^ f {{S + V)y,v)dt 





T 
T 



(4.18) 



U{Sy,y)]^+ / i-USy,y) + iVy,v))dt. 







Combining (|iJB)) . (^17)1 and (|i?T5)) we get the desired result. D 

Corollary 4.7. IfV[X] = t/ien J7 does not involve v explicitly, and it can be expressed in terms 
ofi^,y,yiT)). 

In view of (|4.1ip . the previous corollary holds in particular if [/;,/,] = on the reference 
trajectory for each pair I < i < j < m. 

Corollary 4.8. If w is a weak minimum, then 

max fl-p [A] (^, y, v) > 0, 
AeA 

for every {z,v) G C2 and {^,y) defined by (|4.2p . 

4.3 New second order condition 

In this section we present a necessary condition involving the variable (^, y, h) in 7^2 • To achieve 
this we remove the explicit dependence on v from the second variation, for certain subset of 
multipliers. Recall that we consider A = (a,/3) as elements of R'*. 

Inria 
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Definition 4.9. Given M C W, define 

G{M) := {A e M : V^j[\]{t) = on I\ n /^, for any pair l<i<j<m}. 

Theorem 4.10. Let M C M* fee convex and compact, and assume that 

m&yiVlr,[X]{^,y,y)>Q, for all (^,y,h)eV. (4.19) 

AeM 



Then 



max rip [A] (C, y, y) > 0, for all (^, y,h)er. 

AgG(A/) 



The proof is based on some techniques introduced in Dmitruk |12l I15| for the proof of similar 
theorems. 

Let I < i < j <m and t* e int I^ (1 1]_. Take y e y satisfying 

y(0) = y{T) - 0, yk = 0, for k^t^k^ j. (4.20) 

Such functions define a linear continuous mapping r : R*'* — > M by 

A^r[A]:= / {V[X]{t*)y,y)dt. (4.21) 

Jo 

By condition (|4.20p . and since V^[A] is skew-symmetric, 

/ {V[X]{t*)y,y)dt = V,j[\]{t*) f {y,y, ~ y,y,)dt. 
Jo Jo 

Each r is an element of the dual space of W'*, and it can thus be identified with an element of 
R* . Consequently, the subset of W defined by 

Rij{t*) := {r e M.-' : y e y satisfies ^l20\\ . r is defined by (|4:2T|) }. 

is a linear subspace of R''. Now, consider all the finite collections 

Gy := je = {fi < • • • < t^"} : t^ e int /; n /:{_ for fc = 1, . . . , Nq\ . 

Define 

^-E U E^^.(^'^')- 

i<i eeOij fc=i 

Note that 7^ is a linear subspace of W . Given (^, y, y{T)) G T', let the mapping pj, : R'*'* ^- R be 
given by 

x^Py[X]:^nvmc,y,y)- (4.22) 

Thus, py is an element of W. 

Lemma 4.11. Let {£,,y-,y{T)) e V and r Cz TZ. Then there exists a sequence 
{(r,2/'',y''(r))} inV such that 

nr[XW,y'',r)^Py[M + r[X]. (4.23) 
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Proof. Take {(^,y,y{T)) <S V, its corresponding critical direction {z,v) G C related via (|4.2p and 
Py defined in (|4.22p . Assume that r e Rij{t*) for some I < i < j < m and t* e int /^ n /i{_, 
i.e. r is associated via (|4.2ip to some fmrction y verifying (|4.20p . Take y{t) = when t ^ [0,r]. 
Consider 

rit):^yiHt-t*)), r--^y+r- (4.24) 

Let ^^ be the solution of (j4.3p corresponding to y". Observe that for large enough ly, as t* e 
int /+n4, 

^fc = 0, a.e. on /q, for fc = 1, . . . ,m. (4-25) 

Let {z'^,v'^) and (z",-;;'') be the points associated by transformation (|4.2p with {£,^ , y'^ , y'^ (T)) 
and {l'',y'',y''{T)), respectively. By (jOS)) . we get 

w^ = 0, a.e. on /q , for fc = 1, . . . , m. 

Note, however, that (z*^, v'^) can violate the terminal constraints defining Coo, i-e. the constraints 
defined in (|2.16p . Let us look for an estimate of the magnitude of this violation. Since 

Wh=0{l/u), (4.26) 

and [S,'^ ,y^) is solution of (|4.3I) . Gronwall's Lemma implies 

r{T)\^o{i/v). 

On the other hand, notice that z'-'(r) = z{T) + ^"{T), and thus 

\r(T)~-z{T)\^0{l/v). 

By Hoffman's Lemma (see (22), there exists (Az", Au'") e W satisfying ||Au''||oo + ||Az''||oo = 
0(1/1/), and such that {z" ,v'') := {z'',v'') + {Az'',Av'') belongs to Coo- Let i^" , y" , y" (T)) e "P 
be defined by (|4.2p . Let us show that for each A € M, 

hm l]p[A](r,^/^^/'')=P,-[A] + r[A]. 
Observe that 

hm ^!p[A](r,y^2)'')-p,[A]- hm / {{V[X]y,r) + {V[X]r ,r)}dt, (4.27) 

since the terms involving S,'^ — £,, y'^ — y or Au'^ vanish as H^"^ — ^||oo -> and \\y'^ ^ y||i ^" 0. 
Integrating by parts the first term in the right hand-side of (|4.27p . we obtain 

{V[X]y, r)dt = [(F[A]y, r)]!^ f {{V[\]y. y") + {V[X]y, r)}dt "^^ 0, 
Jo 

by (|i:^ and since ^""(0) = y" {T) = 0. Coming back to ^^HF!) we have 
lim f]7'[A](r,y",2/")-fsW= lim / (l^[A]r,r)dt 

= lim / (y[A](t)y(Ki-i*)),y(^(i-i*)))d^^ 

= lim / (F[A](r+sHy(s),^(s))ds = r[A], 
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and thus (|4.23p holds when r e Rij{t*). 

Consider the general case when r <E TZ, i.e. r = 2. /, 'ijj with each r^j in Rij{tfj). Let yfj 

i<j k=l 

be associated with r*J by (|4.2ip . Define y^^^ as in (|4.24p . and follow the previous procedure for 
y + \^ \J j/j,-'" to get the desired result. 

D 

Proof, [of Theorem [JTTO] Take (^, y, y{T)) e V and r e U. By Lemma HTTI there exists a 
sequence K^", y", y''(T))} in P such that for each A € M, 

nr[XW,y'',r)^^v[xm,y,y) + r[X]. 

Since this convergence is uniform over M, from (|4.19p we get that 

max(f}-p[A](^, y, y) + r[\]) > 0, for all r e 7^. 

inf max(f]p[A](C" y, ^) + r[A]) > 0, (4.28) 

where the expression in brackets is linear both in A and r. Furthermore, note that M and TZ are 
convex, and M is compact. In light of MinMax Theorem [SB Corollary 37.3.2, page 39] we can 
invert the order of inf and max in (j4.28p and obtain 

max miinr[X]{^,y,y) + r[X]) > 0. (4.29) 

AeA/ ?-sv< 

Suppose that, for certain A £ M, there exists r G TZ with r[X] ^ 0. Then the infimum in (|4.29p 
is — oo since 7?. is a linear subspace. Hence, this A does not provide the maximal value of the 
infima, and so, we can restrict the maximization to the set of A £ i\/ for which r[A] = for every 
r G TZ. Note that this set is G{M), and thus the conclusion follows. D 

Consider for i, j = 1, . . . , m : 

/y := {t e (0,T) : u,{t) = 0, Uj{t) > 0}. 
By Assumption 2, /y can be expressed as a finite union of intervals, i.e. 

fc=i 

Let {z,v) £ Coo, i 7^ i, and y be defined by (|4.2p . Notice that yi is constant on each (cf-,(ij^ ). 
Denote with y^ its value on this interval. 

Proposition 4.12. Let {z,v) G Coo, y be defined by (|4.2p and X G G(A). T/ien 

/ {v[x]y, v)dt ^Y.H y'l [^*^- Wy^l^' - / ^^^ t^i^^^-^^ ■ 
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Proof, Observe that 



/ {v[\]y,v)dt= Y. / y^AMy^vJdt, 

Jo ,- / ■ Jo 



(4.30) 






since Vii[X] = 0. Fix i ^ j, and recall that that Vij[X] is difFerentiable in time (see expression 
(|4.1ip ). Since (2;,'!;) e Coo and A <E G(A), 



I Vij[X]yiVjdt ^ Vij[X]ytVjdt^y2 Vij[X]yiVjdt 

Jo J I., fc^i^cj^. 

Kij f Jk ~\ 



(4.31) 



where the last equality was obtained by integrating by parts and knowing that yi is constant on 
hj. The desired result follows from (|4^ and (|43T|) . D 

Given a real function h and c G R, define 

h{c+) := lim h{t), and h{c—) := lim /i(<). 

Definition 4.13. Let {^,y,h) e 7^2 a"d A e G'(A). Lle/ine 
5[A](C,y,/i):= 

i5^j fc=l I ■'f=ij J 

where the above expression is interpreted as follows: 
(i) y,{dfl^+):=h„tf4^^T, 

(a) ^ji[A](4;,)yj(4;,-) := 0, j/u, > and iij > for t < c'^^, 
(Hi) Vij[X]{d!lj)yj{d^j+) := 0, if Ui > and Uj > for t > d^j. 
Proposition 4.14. The following properties for S hold. 

(i) S[A](^, 2/, ft.) is well-defined for each (^,y,h) e 7^2, o,nd X G G(A). 
('Jiy' V{iCy'",y''iT))} C 7^ converges zn the X2XU2X M"- topology to i^,y,h) G 7^2 , i^en 

' {V[X]y-^,r)dt"^E[X]{^,y,h). 

Proof, (i) Take {£_, y, /i) G 7-'2. First observe that yi = yf over {dlj^d^A. As c^i ^ 0, two possible 
situations can arise, 

(a) for t < c^j : Uj = 0, thus yj is constant, and consequently yj{dlj~) is well-defined, 

(b) for t < c'^j : Ui > and iij > 0, thus V^y [A](4j) ^ since A G G(A). 
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The same analysis can be done for t > d^j when d*^- ^ T. We conclude that 5 is correctly defined. 
(ii) Observe that since y" converges to y in the Z//2— topology and since yf is constant over 
lij, then yi is constant as well, and j/,^ goes to yi pointwise on 7^. Thus, y'^{c^j) — > yfj, and 
Vii'^ii) — ^ Vii- Now, for the terms on yj, the same analysis can be made, which yields either 
yj(4) -^ y,(4~) or V,,[X\{c^^) = 0; and, either y^{d^^) -^ y,{d^^+) or V,,[XM^) = 0, when 
djj < T. For d'lj = T, yf^{T) — > hj holds. D 

Definition 4.15. For {£,,y,h) e V2 and A e G{A) define 

ilr, [X]{t y, h) :-g[A](C(T), h) + S[A](^, y, h) 

' ((Q[A]e, 6 + 2(Af [A]e, y) + (i?[A]y, y))df. 



Remark 4.16. Observe that when m ~ 1, the mapping S = since V^ = 0. Thus, in this case, 
Q-p.^ can be defined for any element (^, y, /i) G A2 x W2 x K and any A G A. // we take (z, w) G W 
satisfying (|2.12p . and define (^, y) 6y (j4.2p . f/ien 

f}[A](z,i;) -f}p[A](e,y,y) -r!pJA](e,y,y(r)). 
i^or 771 > 1, i/ie previous equality holds for {z,v) G Coo- 
Lemma 4.17. Lei {{£,'^ , y'^ , y'^ (T)} C V be a sequence converging to (^, y, /i) G P2 J'T- ^^le X2 x 
^^2 X R"^ -topology. Then 

lim fip[A](e^y^n = ^pJA](^,y,/^). 

I/— ^C30 

Denote with co A the convex hull of A. 
Theorem 4.18. Let w be a weak minimum, then 

max n-p. [A](C, y, h) > 0, for all (^, y, h) eV2- (4.32) 

AeG(coA) 

Proof CoroUarv 14.81 together with Theorem 14. 101 applied to AT := coA yield 

max n-p[X]i^,y,y) > 0, for all (e,y,2/(T)) G V. 

AGG(coA) 

The result follows from Lemma UT] and Lemma [4.171 D 

Remark 4.19. Notice that in case (|3.3p is not satisfied, condition (j4.32p does not provide any 
useful information as £ coA. On the other hand, if (j3.3p holds, every A = {a,[3,tp) G A 
necessarily has a 7^ 0, and thus ^ co A. 

5 Sufficient condition 

Consider the problem for a scalar control, i.e. let ?Ti = 1. This section provides a sufficient 
condition for Pontryagin optimality 

Definition 5.1. Given {y,h) G W2 x M, let 

l{y,h):= f yitydt+\h\\ 
Jo 
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Definition 5.2. A sequence {vk} C U converges to in the Pontryagin sense if \\vk\\i — > and 
there exists N such that ||wfe||oo < -^■ 

Definition 5.3. We say that w satisfies j— quadratic growth condition in the Pontryagin sense 
if there exists p > such that, for every sequence of feasible variations {((Jxfc,^^)} with {ufc} 
converging to in the Pontryagin sense, 

J{u + Vk)~J{u)>Pi{yk,yk{T)), (5.1) 

holds for a large enough k, where yk is defined by (|4.2p . Equivalently, for all N > 0, there exists 
e > such that if ||u||oo < N and \\v\\i < e, then (j5.ip holds. 

Definition 5.4. We say that w is normal if Oq > for every A G A. 

Theorem 5.5. Suppose that there exists p > such that 

maxf]pJA](e,2/,/i) > Pl{y,h), for all {^,y,h) e V2. (5.2) 

AeA 

Then w is a Pontryagin minimum satisfying 7— quadratic growth. Furthermore, if w is normal, 
the converse holds. 

Remark 5.6. In case the bang arcs are absent, i.e. the control is totally singular, this theorem 
reduces to one proved in Dmitruk flSl \15^ . 

Recall that $ is defined in (j2.5p . We will use the following technical result. 

Lemma 5.7. Consider {vk} C U converging to in the Pontryagin sense. Let Uk :— u + Vk and 
let Xk be the corresponding solution of equation (|2.2p . Then for every A G A, 

$[A](xfc,Ufc) = $[A](x,u)+ / H^[\]{t)vk{t)dt + ^[\]{zk,Vk) + o{-ik), (5.3) 

where Zk is defined by (j2.12[l . 7^- := l{yk,yk{T)), cind yk is defined by (j4.2p . 
Proof. By Lemma 13.11 we can write 

$[A](a;fc,Ufe)=$[A](.T,u)+ / H.,[X]it)vkit)dt + n[\]{zk,Vk) + Rk, 

Jo 

where, in view of Lemma 18. 5[ 

Rk:^Akn[X]+ f {Hu.4X]{t)5xk{t),5xk{t),Vk{t))dt + oi-rk). (5.4) 

Jo 

with 6xk '.= Xk — X, and 

AkiliX] ■.= n[X]{Sxk,Vk)-n[X]{zk,Vk). (5.5) 

Next, we prove that 

Rk = o{jk). (5.6) 

Note that Q(a, a) — Q{b, b) = Q{a + b,a ~ b), for any bilinear mapping Q, and any pair a, b. Put 
rjk '.— Sxk — Zk. Hence, from (j5.5p . we get 



Akn[X] =U"[X]{x{T)){Sxk{T) + Zk{T),,^k{T)) 



-5/ {H.^^[X]{Sxk+ Zk),r]k)dt+ {Hux[X]7jk,Vk)dt. 
Jo Jo 
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By Lemmas 18.51 and 18.131 in the Appendix, the first and the second terms are of order o{jk)- 
Integrate by parts the last term to obtain 

i-T 

{HuA^]r]k,Vk)dt (5.7) 



[{Hux[X]vk,yk)]o 



{{Hux[)^]r]k,yk) + iHux[X\Vk,yk)}dt. 



(5.8) 



Thus, by Lemma [8. 131 we deduce that the first two terms in (|5.8p are of order 0(7^). It remains 
to deal with last term in the integral. Replace fjk by its expression in equation (|8.13p of Lemma 

1 



/ {Hux[X]rik,yk)dt = I {Hux[\] { J2 ^»A'(^)^fc + ^kf[{x)Sxk + Cfc ) , yk)dt 



(5.9) 



o(7fc 



dt 



Vk 



Hux[\]I[{x)5xkdt, 



where the second equality follows from Lemmas 18. 51 and 18. 131 Integrating the last term by parts, 

we obtain 

- 2 ^T 

Vk 



I ^(y)^-W./i(i)fefedi = 



^vU 



!i^ (H^^[X]f[{x))5xkdt- / ^Hux[X]f[{x)Sxkdt 



fH.u,,[X]f[{x)6xk 

T 2 

Vk 



2 dt 



o(7fe) - 

o(7fc) - 
o(7fe), 



^'^^(f)ffu.[A]/{(x)/i(£)dt 

f if«.[A]/I(x)/i(i)l + r|A(iJ„,[A]/{(i)/i(x))df 
6 Jn ^ 6 dt 



(5.10) 



where we used Lemma [8.131 and, in particular, equation (|8.14p . From (J5.9D and (|5.10p . it follows 
that the term in (j5.7p is of order 0(7^). Thus, 



Akn[X] < o(7fc). 
Consider now the third order term in (|5.4p : 

{Huxx[>^]SxkJxk,Vk)dt = [ykSxJ Huxx[>^]Sxk]o 

I ykSxJ Huxx[\]Sxkdt - 2 ykSxJ Huxx[\]5xkdt 
Jo Jo 



(5.11) 



o(7fc) - 



(5.12) 



di 



{yl)SxJ R,,,[X],h{x)dt 



3(7fc)- [yl^xj HuxxiMfiix)]^ - / ylvkfiix)'^ Huxx[X]fiiS:)dt = oi'jk), 

Jo 



by Lemmas 18.51 and 18.131 The last inequality follows from integrating by parts one more time 
as it was done in (|5.10p . Consider expression (|5.4p . By inequality (|5.1ip and equation (|5.12p . 
equality (|5.6p is obtained and thus, the desired result follows. 

D 
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Proof, [of Theorem I5.5| Part 1. First we prove that if w is a normal Pontryagin minimum 
satisfying the 7— quadratic growth condition in the Pontryagin sense then (j5.2p holds for some 
p > 0. Here the necessary condition of Theorem 13.21 is used. Define y{t) :— J„ u(s)d.s, and note 
that (w, y) is, for some p' > 0, a Pontryagin minimum of 

J ■■= J - Pl{y - y, yiT) - y{T)) -^ min, 

(Ea)-(E3D,y-w, 2/(o) = o. 

Observe that the critical cone C2 for (|5.13p consists of the points {z,v, Sy) in A2 x Z-/2 x W2 (0, T; M) 
verifying {z,v) € C2, Sy = v and Sy{0) = 0. Since the pre-Hamiltonian at point (w,y) coincides 
with the original pre-Hamiltonian, the set of multipliers for (|5.13p consists of the points (A, -01,) 
with A e A. 

Applying the second order necessary condition of Theorem l3.2l at the point (w, y) we see that, 
for every (z, v) £ C2 and 6y{t) := J^ v{s)ds, there exists A S A such that 

n[X]iz,v) - aop'i\\Sy\\l + Sy^T)) > 0, (5.14) 

where ag > since w is normal. Take p := miuAeA ckop' > 0. Applying the Goh transformation 
in (|5.14p . condition (|5.2p for the constant p follows. 

Part 2. We shall prove that if (|5.2p holds for some p > 0, then w satisfies 7— quadratic growth 
in the Pontryagin sense. On the contrary, assume that the quadratic growth condition (|5.ip is 
not valid. Consequently, there exists a sequence {v^} C U converging to in the Pontryagin 
sense such that, denoting Uk := u + Vk, 

J(w + Ufc)< J(u)+o(7fc), (5.15) 



where yk{t) := L Vk{s)ds and 7^ := j{yk,yk{T)). Denote by Xk the solution of equation (j2.2p 
corresponding to u^-, define Wk := (xk, Uk) and let Zk be the solution of (j2.12p associated with Vk- 



d„ 



Take any A € A. Multiply inequality (|5.15p by aoi add the nonpositive term X]?:=o (^iVii^kiT)) + 
J2j=i t^jVji^kiT}) to its left-hand side, and obtain the inequality 

^\]{xk,uk) < ^\]{x,u) + o{-fk). (5.16) 

Recall expansion (|5.3p . Let {yk, hk) := (2/fcj2/fc(T))/-y/7fc. Note that the elements of this sequence 
have unit norm in hi2 x M. By the Banach-Alaoglu Theorem, extracting if necessary a sequence, 
we may assume that there exists (y, /i) G Z-/2 x K such that 

Tjk -^ y, and hk -)■ h, (5.17) 

where the first limit is taken in the weak topology of U2 . The remainder of the proof is split into 
two parts. 

(a) Using equations (j5.3p and (j5.16p we prove that (<^, y, h) €7^2, where ^ is a solution of (|4.3p . 

(b) We prove that {y,h) = and that it is the limit of {{yk,hk)} in the strong sense. This 
leads to a contradiction since each (y^, hk) has unit norm. 

(a) We shall prove that (f, y, h) £V2- From ((0|) and (|57TO)l it follows that 
< / H.u[X\{t)vk{t)dt < -n-p,M^k,yk, hk) + o(7fc), 
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where ^^ is solution of (|4.3p corresponding to i/k- The first inequahty holds as Hu[X\vk > almost 
everywhere on [0,r] and we replaced Q-p by fi-p^ i^i view of Remark 14.161 By the continuity of 
mapping ft-p^ [A] over <Y2 x Z//2 x K deduce that 

o< / Hu[xmvkmt<oijk), 



Jo 
and thus, for each composing interval (c, d) of /q, 



lim / Hu[X]it)ip{t)^^dt = 0, (5.18) 



'^^■^ Jc V 7fc 

for every nonnegative Lipschitz continuous function tp with supp<y9 C (c, d). The latter expression 
means that the support of ip is included in (c, d) . Integrating by parts in (j5.18p and by (|5.17p we 
obtain 

= lim / A {H^[X](tMt)) y,{t)dt = / ^ (if„[A](t)^(t)) y(t)dt. 



dt ' ' " "^' ""^ ' J^ di 

By Lemma 18.61 y is nondecreasing over (c, d). Hence, in view of Lemma l8.8[ we can integrate by 
parts in the previous equation to get 

d 

H,,[X]{t)^it)dy{t) ^ 0. (5.19) 

Take to € {c,d). By the strict complementary in Assumption 1, there exists Ag G A such that 
Hu[Xo]{to) > 0. Hence, in view of the continuity of iJ„[Ao], there exists e > such that iJ„[Ao] > 
on (ig — 2£,to + 2e) C (c, d). Choose (p such that suppiy9 C {to — 2e,to + 2e), and Hu[Xo]{t)ip{t) — 1 
on {to — e,to + e). Since dy > 0, equation (|5.19p yields 

0= / H^[X]{t)ip{t)dy{t) > f" H.u[X]it)ip{t)dy{t) 

l-to+e 

<^y{i) = y{to + e) - y{io - e)- 

lt(,-e 

As e and to S (c, d) are arbitrary we find that 

dj/(t)=0, on/o, (5.20) 

and thus (j4.7p holds. Let us prove condition (j4.8p for (^, y, /i). Suppose that e /q. Take e > 0, 
and notice that by Assumption 1 there exists A' e A and (5 > such that iJ„[A'](i) > 5 for 
t G [0, di — e], and thus by (|5.18p we obtain L ^ Vk{t) / ^J^dt -^ 0, as Vk > 0. Then for all 
s € [0, di), we have 

yk{s) ^ 0, 

and thus 

y ==0, on [0,di), if G h- (5.21) 

Suppose that T G /q. Then, we can derive J Ufc(t)dt — > by an analogous argument. Thus, 
the pointwise convergence 

hk - yk{s) -^ 0, 

holds for every s € [ajq^T], and then, 

y = /i, on(aw,T], if Tg/q. (5.22) 
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It remains to check the final conditions (|4.6p for h. Let < i < d^, 



^mTMiT) + B{T)h) ^ hm ^'MT)) ( UT) + B{T)h, \ 

= lim ^[{xiT))-"^^^ 



Since Xk satisfies (j2.4p . equations (|5.23p and (j5.24p yield, ioi 1 < i < d^p : 
ip[{x{T))(^{T) + B{T)h) <O.FoT:i = use inequality ((5TT5)) . Analogously, 

77;(£(T))(C(r) + B{T)h) = 0, for j = 1, . . . , d^. 
Thus (^, y, /i) satisfies (jMl), and by ([OO)) . ((OT|) and (|0^ . we obtain 

(b) Return to the expansion (|5.3p . Equation (|5.16p and -ff«[A] > imply 

^•P2W(Cfc,2/fc,yfc(r)) = 

$[A](xfc,Wfe) - $[A](.T,u) - / Hu[X]vkdt - o{-fk) < o{-ik). 

Jo 

Thus 



Split 51 -p2 as follows, 



(5.23) 



k—^oo \/^k 

A first order Taylor expansion of the function (pi around x{T) gives 

ip^{xu{T)) = ¥>.(£(T)) + ^Ki(7^))fefc(r) + 0(|fefc(T)n. 
By Lemmas 18.51 and 18.131 in the Appendix, we can write 

ip,{xu{T)) = ip,{x{T)) + ip[{x{T))zk{T) + o{^). 
Thus 

\/lk Jlk 



liminfnp2[A](^fc,2/fc,/ifc) < limsupr2p2[A](^fc, y^, /ifc) < 0. (5.25) 

fc-s-oo k^oo 



nv,,^[m,y,h) := I {(Q[A]C,0 + (A/[A]e,y)}dt + 5[A](C(T),/i), 



f2p„o[A](2/) := / (i?[A]y,y)dt, 

and 

fii,„+[A](y) := / (i?[A]y,y)dt. 

Notice that ri-p2.u,[A] is weakly continuous in the space ^2 x W2 x K. Consider now the subspace 
T2 := {(?, y, /i) e A-a X Z^2 X M : (gSD, g2D and gSD hold} . 
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Notice that r2 is itself a Hilbert space. Let p > be the constant in the positivity condition 
(|5.2p and define 

A'' := {A e CO A : fip2[A] — pj is weakly l.s.c. on r2}. 

Equation (|5.2p and Lemma lS.f 2l in the Appendix imply that 

maxf}pJA](^",y,/i) > fnivM- (5-26) 

AgAp 

Denote by A the element in A'' that reaches the maximum in (|5.26p . Next we show that i?[A](i) > 
p on /+. 

Observe that fi-p^oi^] ^ P Jr |y('')Pdt is weakly continuous in the space r2. In fact, consider 

a sequence {(^fc,yfc,^fe)} C T2 converging weakly to some (^,y,h) G T2. Since y^ and y are 
constant on /q, necessarily y^ ^>- y uniformly in every compact subset of /q. Easily follows that 

lim nv^Miyk) -P I \yk{t)\^dt = Op„o[A](y) -p ( |y(i)l'di, (5.27) 

^^°° Jlo Jlo 

and therefore, the weak continuity of Sl-p^oiA] — p Jj \y{t)\'^dt in r2 holds. Since r2-p2[A] — p-f is 
weakly l.s.c. in r2, we get that the (remainder) quadratic mapping 

y ^ nr,,+ my) - P f \y{t)\'dt, (5.28) 

Ji+ 

is weakly l.s.c. on r2. In particular, it is weakly l.s.c. in the subspace of r2 consisting of the 
elements for which y = on /q. Hence, in view of Lemma 18.111 in the Appendix, we get 

R[X]it)>P, on/+. (5.29) 

The following step is proving the strong convergence of yk to y. With this aim we make use 
of the uniform convergence on compact subsets of /q, which is pointed out in Lemma 18.71 

Recall now Assumption 2, and let N be the number of connected components of Iq. Set 
e > 0, and for each composing interval (c, d) of /o, consider a smaller interval of the form 
(c + e/2N, d — e/2N). Denote their union as Iq. Notice that /o\/o i'' of measure e. Put /^ := 
[0, T]\Iq. By the Lemma [57^ in the Appendix, R[X]{t) is a continuous function of time, and thus 
from (|5.29p we can assure that i?[A](t) > p/2 on /^ for e sufficiently small. Consequently, 

^P„+[A](2/):= / {R[X]y,y)dt, 

is a Legendre form on L2{I^), and thus the following inequality holds for the approximating 
directions y^, 

^v, +W(y) < liminf r!^2 +[A](yfc). (5.30) 

Since the sequence y^ converges uniformly to y on every compact subset of Iq , defining 

f^^„o[A](y) := / {R[X]y,y)dt, 

we get 

lim C!^2_o[A](a,yfe,/ifc) = ^'r,AM,y~h)- (5-31) 

fe— >oo 
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Notice that the weak continuity of fip^ q [A] in r2 cannot be apphed since 

{^kyVkjhk) 4- r2- From positivity condition (j5.2p . equations (j5.30p . (|5.31|1 . and the weak conti- 
nuity of f7-p2^^,[A] (in <Y2 X Z//2 X ^) we get 

Pl{y,h) <n-p,_[X]{^,y,h) < hm n-p^^^[X]{^k,yk,hk) + lim r2|, o[A](yfc) 

k^)-oo k—^00 

-l-hminf r2|, +[A](2/fc) = limini n-p^[X\{^k,yk,hk). 

On the other hand, inequahty (|5.25p impHes that the right-hand side of the last expression is 
nonpositive. Therefore, 

(y, h) = 0, and hm fi-p^ [A](ffc, y^, hk) = 0. 
k—^00 

Equation (|5.3ip yields limfc^tx> ^p^^q W(ffc' ^fc' ^^k) = and thus 

lim r!|,^+[A](yfc) = 0. (5.32) 

We have: il^^ ^[X] is a Legendre form on L2{I^) and y^ -^ on /^. Thus, by (|5.32p . 

Vk-^O, oni2(/+)- 

As we already noticed, {yk} converges uniformly on /q, thus the strong convergence holds on 
[0,T]. Therefore 

{yk,hk) ^ (0,0), onU2xR. (5.33) 

This leads to a contradiction since (y^, hk) has unit norm for every k e W. Thus, w is a Pontryagin 
minimum satisfying quadratic growth. 

D 

6 Extensions and an example 

6.1 Including parameters 

Consider the following optimal control problem where the initial state is not determined, some 
parameters are included and a more general control constraint is considered. 

J := ipn{x{0), x(r), r(0)) -^ min, (6.1) 

m 

x{t) = Y,Mt)Mx{t).r{t)), (6.2) 

i=0 

f(i) = 0, (6.3) 

at <Ui{t) < 6,, for a.a. t G (0,T), i = l,...,m (6.4) 

ipiixiO), x(r), r(0)) < 0, for i = 1, . . . , d^, (6.5) 

ryj(x(0),x(T),r(0))=0, for j = 1 . . . , d^, (6.6) 

where m G W, a; € A", r G M"'' is a parameter considered as a state variable with zero-dynamics, 
a,6 G M™, functions /i : M"+"'- -> M", ^^ : k2«+«, ^ j^^ g^^^j ^ . ^2n+n,. _^ ^d^ ^^^ ^^j^g 

continuously differentiable. As r has zero dynamics, the costate variable ipr corresponding to 
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equation (j6.3p does not appear in the pre-Hamiltonian. Denote with ip the costate variable 
associated with (|6.2p . The pre-Hamihonian function for problem (|6.ip - (|6.6|l is given by 

m 

H[X]{x,r,u,t) ^ip{t)^Uif.i{x,r). 

i=0 

Let {x,f,u) be a feasible solution for (j6.2p - (|6.6p . Since f(-) is constant, we can denote it by f. 
Assume that 

ipi{x{0),x{T),f) = 0, for i ^0,. . . ,d^. 

An element A = {a, l3,ip^,ipr) € M'^^.+d^+i x W^{0,T;W'^*) x VKi(0,T;M"-*) is a Pontryagin 
multiplier for {x, ?", u) if it satisfies (j2.7|) . (j2.8|) . the costate equation for -0 

-V-.W = i/.[A](i;(t),f,u(t),i), a.e. on [0,r] 
V'.(O) = -4o[A](x(0), x(T),f), 
0x(T)=4^[A](i;(O),x(r),f), 



and for "0^ 

J -^^(t) = Hr[X]ix{t),f,uit),t), a.e. on [0,r] 
j Vr(0) = -4[A](i(0),x(T),f), 0,(T) = 0. 

Observe that (|6.7p implies the stationarity condition 

4(a;(0),i(T),f)+ / Hr[X]{t)dt = 0. 



(6.7) 



Jo 
Take v ^lA and consider the linearized state equation 

m m 

z{t)=Y,Mt)U^AHt),f)zit) + f,Ax{t),f)^r{t)]+J2v^{t)f^ixit),r), 
j=0 i=l 

(5r(t) = 0, 



(6.8) 



where we can see that Sr(-) is constant and thus we denote it by Sr. Let the linearized initial-final 
constraints be 

^'MO),HT),r){z{0),z(T),Sr)<0, for z = 1, . . . ,d^, 
r,rixiO),xiT),f)iziO),z{T),Sr) = 0, for j = 1, . . . , d^. 

Define for each i = I, . . . ,m the sets 

II := {i e [0,r] : maxi7„JA](i) > 0}, 
AeA 

/,; := {t e [0,r] : maxi7„JA](t) < 0}, 
AeA 

rL,:=[0,T]\{i:ull). 

Assumption 3. Consider the natural extension of Assumption 2, i.e. for each i = 1, . . . , m, the 
sets II and I^ are finite unions of intervals, i.e. 

K K 
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for n ^ and /| ^ being subintervals of [0, T] of the form [0, c), {d, T]; or (c, d) if c 7^ and d ^T. 
Notice that P^C\ II = 0. Call c\ ^ < di a < '^2 a < • • ■ < '^^n' a "^ '^JV' a ^^^ endpoints of these 
intervals corresponding to bound a, and define them analogously for b. Consequently, 7*;^ is a 
finite union of intervals as well. Assume that a concatenation of a bang arc followed by another 
bang arc is forbidden. 
Assumption 4. Strict complementarity assumption for control constraints: 

{/* = {t e [0,T] : Ui{t) = ai}, up to a set of null measure, 
II — {t IE [0, T] : Ui{t) — bi}, up to a set of null measure. 

Consider 

J {z,6r,v) e ,^2 X K"- X Z^2 : dH^-dSlD hold,| 

I Wj = on /* U /^, for i :=: 1, . . . , m J 

The Goh transformation allows us to obtain variables (^, y) defined by 



y{t) := 

Notice that ^ satisfies the equation 



/ w(s)ds, ^ := z- Vj/Jj, 






where, denoting [fz, fjf := /,,x/j - fj,xfi: 



m 771 



(6.10) 



(6.11) 



1=0 4=0 j = l i=0 

Consider the transformed version of (|6.9p . 

^:(x(0), i(T), f)(e(0), C(T) + B(T)/i, fr) < 0, J = 1, . . . , d^, 
r;^.(£(0), x(T), f)(e(0), ^(r) + i?(r)/i, 5r) = 0, j = 1, . . . , d^, 

and let the cone V be given by 

J (C, (5r, y, /i) e A" X R"- X 3^ X R"' : y(0) = 0, /i = y(T), "I 
'~ \ (jglU)) and (|OT|) hold, y[ = on /* U /^, for i = 1, . . . , m J ' 

Observe that each (^, (5r, y,h) E V satisfies 

yi constant over each composing interval of /* U /^, (6-12) 

and at the endpoints. 



(6.13) 



y, = on [0, d], if € /^ U I^, and, 
y, ^h, on [c,Tl ii T e I^U I^ 

where [0, d) is the first maximal composing interval of II U I^ when € /f U /^, and (c, T] is its 
last composing interval when T S J* U /^. Define 

_ j (C, (5r, y, /i) G A-a X R"^ x ^^2 x R™ : 1 

^ '^ [ (|O0)) . (|6JT|) . (IO2I1 and (|6J3)) hold for i = 1, . . . ,mj ' 
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Recall definitions in equations (|4.9p . (|4.10p . (|4.13p . (|4.14p . (|4.15p . Minor simplifications appear 
in the computations of these functions as the dynamics of r are null and 6r is constant. We 
outline these calculations in an example. 

Consider M C W and the subset of M C M' defined by 

G{M) := {A e M : V,,[X] = on 4\„g n /fi„g, for every pair 1< ^ ^ j < m}. 

Using the same techniques, we obtain the equivalent of Theorem 14.181 

Corollary 6.1. Suppose that (a;,f,M) is a weak minimum for problem (J6.ip - (j6.6p . Then 

max Q-p^ [^](?j ^^1 J/j h) > 0, for all (^, Sr, y, h) £V2- 

AeG(coA) 

By a simple adaptation of the proof of Theorem 15.51 we get the equivalent result. 
Corollary 6.2. Let m = 1. Suppose that there exists p > such that 

ma.xnv,[X]iC,6r,y,h)>pj{y,h), for aU (^, (5r, y, /i) e Ps- (6.14) 

AeA 

Then (x,f,u) is a Pontryagin minimum that satisfies ^~ quadratic growth. 

6.2 Application to minimum-time problems 

Consider the problem 

J := T ^f min, 

s.t. dSSD-dS^. 

Observe that by the change of variables: 

x{s)^x{Ts), u{s)^u{Ts), (6.15) 

we can transform the problem into the following formulation. 
J := r(0) -^ min, 

m 

x{s) = T{s) Y^ Ui{s)fi{x{s), r{s)), a.e. on [0, 1], 

i=0 

f{s) = 0, a.e. on [0, 1], 

T(s) = 0, a.e. on [0,1], 

Ui < Ui{s) < bi, a.e. on [0, 1], i = 1, . . . ,to, 

(^,(x(0),a:(l),r(0)) <0, for i = 1, . . . ,d^, 

7?j(a;(0),x(T),r(0)) - 0, for j = 1 . . . ,d^. 

We can apply Corollaries 16.11 and 16.21 to the problem written in this form. We outline the 
calculations in the following example. 
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6.2.1 Example: Markov-Dubins problem 

Consider a problem over the interval [0,T] with free final time T : 

J := T ^' min, 

ii = — sinxa, xi(0) = 0, xi{T) = &i, 

±2 = COSX3, X2(0) = 0, X2{T) = 62, (6.16) 

X3^u, 2:3(0) = 0, X3{T)^e, 

-1 <M < 1, 

with < < TT, bi and 62 fixed. 

This problem was originally introduced by Markov in [32] and studied by Dubins in |18) . 
More recently, the problem was investigated by Sussmann and Tang |60| , Soueres and Laumond 
|56j . Boscain and Piccoli jT], among others. 

Here we will study the optimality of the extremal 

r 1 on [0,0], 
"(*)^=lo on(0,f]. (6-^^) 

Observe that by the change of variables (j6.15p we can transform (|6.16p into the following problem 
on the interval [0, 1]. 

J := T(0) -^ min, 

ii(s) = -T(s)sinx3(s), xi(0)=0, xi(l)=6i, 
X2is) = T{s) cos X3{s), X2(0) = 0, 2:2(1) = 62, 
X3is) = T{s)u{s), 2:3(0) = 0, 2:3(1) = e, 
t{s) = 0, 
- 1 < u{s) < 1. 

We obtain for state variables: 

^^^ 1 9 on(0/T,l], ^ ' 

. , . _ r cos(fs) - 1 on [0,6/ f], 

2^1 (s j - I rp ^i^g(^Q/f _ 5) + cos 61 - 1 on {e/f, 1] , 

. , . _ r sinfs on [Q,9/f], 

X2{s)-<^ f cose{s- e/f) + sine on{e,f]. 

Since the terminal values for xi and 2:2 are fixed, the final time T is determined by the previous 
equalities. The pre-Hamiltonian for problem (j6.18p is 

H[X]{s) -.^ T{s){-Ms) sinx3{s)+ Ms) cos X3{s) + MsHs))- (6.20) 

The final Lagrangian is 

3 

e := aoT(l) + ;^(/3J'2:,(0) + /3,2:,(1)). 
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As ipi = 0, and i/'2 = 0, we get 

V-i-zSi, ^2=/32, on [0,1]- 
Since the candidate control u is singular on [0/T, 1], we have -/^^[A] = 0. By (|6.20p . we obtain 

Ms)^0, on[e/f,l]. (6.21) 

Thus /33 = 0. In addition, as the costate equation for V'3 is 

-1p3 = r(-^iC0SX3 - f32SmX3), 

by a^J^ and (jOTjl . we get 

/3icos6' + /32sin6l = 0. (6.22) 

From (16.1911 and (|6.2ip and since H is constant and equal to — ag, we get 

H = f{~Pisme + P2COse) = ~ao. (6.23) 

Proposition 6.3. T/ie following properties hold 

(i) ao > 0, 

(a) H.u[X\{s) <0 on [0, e/f) for all A e A. 
Proof. Item (i) Suppose that ao = 0. By (|6.22p and (|6.23p . we obtain 

/3i cos + (32 sin 9 = 0, and — /3i sin 6 + (32 cos 9 = 0. 

sin ^ 

Suppose, w.l.g., that cos9 ^ 0. Then (3i = —ft r and thus 

cost' 

■ 2 n 

(32^^ +(32 cos 9 = 0. 
cos 9 

We conclude that /32 = as well. This implies (ao, /3i,/32, /^s) = 0, which contradicts the non- 
triviality condition (|2.7p . So, ao > 0, as required. 
Item (ii) Observe that 

Hu[\]is)<0, on [0,9/ f), 

and Hu[X] = f/'a- Let us prove that 1(^3 is never on [0,9/T). Suppose there exists si G [0,9/T) 
such that V'3('Si) = 0. Thus, since i('3{9/T) = as indicated in (|6.2ip . there exists S2 G (si, 9/T) 
such that ip3{s2) = 0, i.e. 

/3i cos(f.S2) + (32 sin(f S2) = 0. (6.24) 

Equations (pT^ and (pTMj) imply that tan(6'/T) = tan(s2/T). This contradicts 9 < n. Thus 
^3(3) 7^ for every s G [0,0/T), and consequently, 

i?„[A](s)<0, for sG [0,6l/t). 

D 
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Since ao > 0, then ST = for each element of the critical cone, where ST is the linearized 
state variable T. Observe that as u = 1 on [0, 9/T], then 

y = and e = 0, on [0, 0/f], for all (^, ST, y, h) e 7'2- 

We look for the second variation in the interval [0/T, 1]. The Goh transformation gives 

6 = Z3 - fy, 

and since is = Tv, we get z^ — Ty and thus ^3 — 0. Then, as H^x ~ and i" — 0, we get 

n[X]= I {/3i sin - /32 cos 0)y^dt = ao [ y^dt. 

JB/f Jo 

Notice that if (C, ST, y, /i) G 7^2, then h satisfies ^3(T) + fh^O, and, as ^3(r) = 0, we get /i = 0. 
Thus 

^[Mity,h)^ao y'^dt = ao'y{y,h), on 7^2 ■ 
Jo 

Since Assumptions 3 and 4 hold, we conclude by CoroUarv 16.21 that {x,T,u) is a Pontryagin 
minimum satisfying quadratic growth. 

7 Conclusion 

We provided a set of necessary and sufficient conditions for a bang-singular extremal. The suffi- 
cient condition is restricted to the scalar control case. These necessary and sufficient conditions 
are close in the sense that, to pass from one to the other, one has to strengthen a non-negativity 
inequality transforming it into a coercivity condition. 

This is the first time that a sufficient condition that is 'almost necessary' is established for a 
bang-singular extremal for the general Mayer problem. In some cases the condition can be easily 
checked as it can be seen in the example. 

8 Appendix 

Lemma 8.1. Let 

X ■.= {{^,y,h)eX2 XU2 xM'" : gj]), gJl)-g3) hold}, 

L := {{^,y,y(T)) eXxyx K" : y{0) = 0, gSD and gT])}. 
Then L is a dense subset of X in the A2 x Z-/2 x M."^ — topology. 

Proof. (See Lemma 6 in [TT].) Let us prove the result for m = 1. The general case is a trivial 
extension. Let (^, y,h) G X and e,S > 0. Consider (j> € y such that ||y — (/)||2 < e/2. In order to 
satisfy condition (|4.8p take 

ys{t):^0, forte [0,di], if ci = 0, 
ys{t):^h, for t e [cAr,T], \i d^ ^T, 

where Cj, dj were introduced in Assumption 2. Since y is constant on each Ij, define ys constant 
over these intervals with the same constant value as y. It remains to define ys over /+. Over each 
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maximal composing interval (a, b) of /+, define yg as described below. Take c := y{a—) if a > 0, 
or c := if a = 0; and let d := y{b+) ii b < T, or d := h when b = T. Define two affine functions 
ii^s and ^2,1? satisfying 

ii^sia) = c, ii^sia + S) ^ (f){a + S), 

e2Ab)^d, l2,5{b-5)^<t>{b~5). ^ ■ ' 

Take 

{(.i,s{t), for t e [a, a + 5], 

c^{t), iovt^{a + 5,b-5), (8.2) 

4,5(0, forte [&-5,fo], 

and notice that \\4> — y^lUja.b] ^ ■^ max (|c|, |(i|, Af ), where M :— supj^r^, y |'/'(i)|- Finally, observe 
that ys{T) = h, and, for sufficiently small (5, 

Wv-vsh < !|y-'^ll2 + ||<^-2;A-!l2 < £• 

Thus, the result follows. D 

Lemma 8.2. Let A e A and {z,v) E €2- Then 

d^ dn 

g«,^'/(^)(«,t;)+^/3,f^;'(u)(«,i;) = f}[A](z,t;). (8.3) 

Proof. Let us compute the left-hand side of (|8.3p . Notice that 

J2c^^V^iu) +Y.Pjfj,iu) = i[X]ixiT)). (8.4) 

1=0 i=l 

Let us look for a second order expansion for £. Consider first a second order expansion of the 
state variable: 

X = X + Z+ ^Zyy + 0(||U||^), 

where z^jy satisfies 

Zyy = Azyy + Df^^^^-^2F{x,u){z,v)'^, z„,i,(0) = 0, (8.5) 

with F{x, u) := X]i;=o ^ifii^)- Consider the second order expansion for £ : 

e[\]{x{T)) ^e[x]{{x + z + iz™)(r)) + oiMJ) 

^e[X]{x{T)) + £'[X]{x{T)){z{T) + iz™(r)) (8.6) 

+ ir [A](x(T))(z(T) + iz„.(r))2 + odIHI?). 

step 1. Compute 

i'[X]{xiT))zyy{T) = V(T)z™(T) - V(0)z™(0) 

= / [lpZyy+tl;Zyy]dt= / {^ ^/j AZyy + l/j {AZyy + D'^ F(^,j. .^^ {z , v)'^ )} dt 

Jo Jo 

= / D'^H[X]{z,vfdt. 
RR n° 7664 Jo 
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Step 2. Compute i"[X]{x{T)){z{T),Zvv{T)). Applying Gronwall's Lemma, we obtain jl^jltxj = 

0(||«|li), and |lz,„„|U = 0(||i;2||i). Thus 

|(z(T),z.„(r))HO(|K>||?), 

and we conclude that 

\i"[X]ix{T))iz{nzUT))\^0{\\v\\l). 

Step 3. See that i"[X\{x{T)){zyy{T))^ = 0{\\v\\i). Then by dHU) we get, 

e[X]ix{T))=e[X]ixiT))+i'[X]iS:iT))ziT) 

+ ir [A](x(T))z2(T) + i r Dl,.^^.H[X]iz, v^dt + oiMJ) 

JQ 

=m{i{T)) + e[X]{x{T))z{T) + 0[A](z,«) + o{\\v\\l). 
The conclusion follows by (|8.4p . D 

Lemma 8.3. Given (z, w) G W satisfying (|2.12p . i/ie following estimation holds for some p > : 

11^11^ + k(r)p<P7(y,y(r)), 

where y is defined by (j4.2p . 

Remark 8.4. p depends on w, i.e. it does not vary with (z,u)- 

Proof. Every time we mention pi we are referring to a constant depending on |]A||oo7 ||-B||oo or 
both. Consider ^, the solution of equation (j4.3p corresponding to y. Gronwall's Lemma and the 
Cauchy-Schwartz inequality imply 

liei|oo<Pi||2/||2. (8.7) 

This last inequality, together with expression (|4.2p . implies 

lk||2<||e!|2 + ||S||oo!|y||2<P2b|l2. (8.8) 

On the other hand, equations (|4.2p and (|8.7p lead to 

\z{T)\ < |C(T)| + ||i?||oo|2/(r)| < p,\\yh + l|S||oo|j/(T)|. 

2,. 2 

Then, by the inequahty ah < ^ ^ , we get 

\z{T)?<Pz{\\y\\l + \y{T)\^). (8.9) 

The conclusion follows from equations (|8.8p and (j8.9p . D 

The next lemma is a generalization of the previous result to the nonlinear case. See Lemma 
6.1 in Dmitruk |15j . 

Lemma 8.5. Let w = {x,u) be the solution of (|2.2p with \\u\\2 < c for some constant c. Put 
{Sx, v) :— w — w. Then 

\Sx{T)\' + \\Sx\\l<pjiy,yiT)), 

where y is defined by (j4.2p and p depends on c. 

Lemma 8.6. Let {yt} C L2(a, 6) be a sequence of continuous non- decreasing functions that 
converges weakly to y Cz L2{a,b). Then y is non- decreasing. 
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Proof. Let s,t £ (a, b) be such that s < t, and eo > such that s + Eq < t — Eq. For every k e IV, 
and every < e < Eq, the foUowing inequahty holds 

s+€ rt+s 

yk{v)dv < / yk{v)dv. 



: J t — e 

Taking the hmit as k goes to infinity and niuhiplying by ^, we deduce that 

1 rs+e 1 pt+E 



2g , V{v)dv < ^ / y{v)dv. 

As (a, 6) is a finite measure space, y is a function of ii(a, 6) and almost all points in (a, &) are 
Lebesgue points (see Rudin [52l Theorem 7.7]). Thus, by taking e to 0, it follows from the 
previous inequality that 

y{s) < yit), 

which is what we wanted to prove. D 

Lemma 8.7. Consider a sequence {yk} of non- decreasing continuous functions in a compact 
real interval I and assume that {yk} converges weakly to in L2{I). Then it converges uniformly 
to on any interval (a, b) C /. 

Proof. Take an arbitrary interval (a, b) C /. First prove the pointwise convergence of {j/fc} to 
0. On the contrary, suppose that there exists c € (a, &) such that {yfc(c)} does not converge to 
0. Thus there exist e > and a subsequence {yk} such that yk (c) > e for each j G IN, or 
Vkj (c) < — e for each j € IV. Suppose, without loss of generality, that the first statement is true. 
Thus 

< e(6- c) < yk,ic)ib - c) < j yk,{t)At, (8.10) 

where the last inequality holds since yk is nondecreasing. But the right-hand side of (|8.10p goes 
to as J goes to infinity. This contradicts the hypothesis and thus the pointwise convergence of 
{yk\ to follows. The uniform convergence is a direct consequence of the monotonicity of the 
functions y^- D 

Lemma 8.8. /,^ft Theorem 22, Page 154 - Volume I] Let a and b be two functions of bounded 
variation in [0,r]. Suppose that one is continuous and the other is right- continuous. Then 

a{t)db{t) + f b{t)da{t) = [afe]^+. 

"'0 

Lemma 8.9. Let ni — 1, i.e. consider a scalar control variable. Then, for any A £ A, the 
function R[X](t) defined in (I4.13P is continuous in t. 

Proof Consider definition (|im)) . Condition V[X] = yields S[X] == C[X]B, and since R[X] is 
scalar, we can write 

R[X] = B^Q[X]B - 2C[X]Bi - C[X]B - C[X]B. 

Note that B = /i, Bi = [/o, /i], C[X] = -^f[, and 0[A] = -^{f^ + uf'{. Thus 

R[A =V^(/o' + "/r)(/i, /i) - 2V^/{(/^/i - f'M 

+ V'(./o + uf[)fifi ~ yjf['ifo + ufi)fi - V/{/{(/o + ufi) 
=V'[/i,[./i,/o]]. 

Since /o and /i are twice continuously differentiable, we conclude that R[X] is continuous in 
time. D 
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Lemma 8.10. (28^ Consider a quadratic form Q = Qi + Q2 where Qi is a Legendre form and 
Q2 is weakly continuous over some Hilbert space. Then Q is a Legendre form. 

Lemma 8.11. 128^, Theorem 3.2] Consider a real interval I and a quadratic form Q over the 
Hilbert space L2{I), given by 

Q{y) := j y-^ {t)R{t)y{t)At. 

Then Q is weakly l.s.c. over L2{I) iff 

R{t) h 0, a.e. on /. (8.11) 

Lemma 8.12. '14-', Theorem 5] Civen a Hilbert space H, and ai, 02, . • • , Op € H, set 

K :^{xe H : {a^,x) < 0, for i = l,...,p}. 

Let M be a convex and compact subset of W , and let {Q'^' : ip G M} be a family of contin- 
uous quadratic forms over H with the mapping ip — > Q^' being affine. Set M^ := {ip E M : 
Q^ is weakly l.s.c.} and assume that 

maxQ'f'(x) > 0, for all x e K. 

tpeM 

Then 

max Q'^(x) > 0, for all x e K. 

The following result is an adaptation of Lemma 6.5 in [15| . 

Lemma 8.13. Consider a sequence {vk\ C lA and {yk\ their primitives defined by (14. 2p . Call 
Uk '.= u + ffc, Xk its corresponding solution of (|2.2p . and let Zk denote the linearized state 
corresponding to Vk, i.e. the solution of (j2.12p . Define, for each k G IN, 

Sxk -.^ Xk- X, rjk -.^ Sxk - Zk, ^k-=l{Vk,Vk{T)). (8.12) 

Suppose that {wfe} converges to in the Pontryagin sense. Then 

(i) 

m m 

Vk = ^Utfi{x)r]k + ^Vi^kfi{S:)5xk + Ck, (8.13) 

m m 

Sxk = ^Ui,kfi{x)6xk +^Wj,fc/i(i) + Ck, (8-14) 

i=0 i=l 

where WCkh < o{^f%) and |JCfc||oo ^ 0, 

(a) hfelloo < 0(77^). 

Proof. (i,ii) Consider the second order Taylor expansions of /i, 

f^{xk) = f^{x) + f[{x)6xk + y[' {x){5xk, 5xk) + o{\5xk{t)\'') . 
We can write 

m m 

Sxk = '^Ui^kfi{x)Sxk +'^Vi^kfi{x) + Ck, (8.15) 



i=0 i=l 
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with 

m m 

i=0 4=0 

As {uk} is bounded in Loo and ||5a;fe||cx) ^^ 0, we get ||Cfc||oo -^ and the fohowing L2— norm 
bound: 

m m 

Kkh<const.^\\ui^k{Sxk,5xk)\\2 + o{'jk)\\^Ui,k\\i 

j=o 1=0 (8-17) 

< const.\\uk\\oo\\Sxk\\l = 0{"fk) < 0(^/7^). 

Let us look for the differential equation of i]k defined in (|8.12p . By (j8.15p . and adding and 
substracting the term X]i=i ^ifi{x)5xk we obtain 

711 m 

Vk = ^ Uifiix)T]k + ^ Vi^kfi{x)Sxk + Cfc- 
1=0 i=l 

Thus we obtain (i). Applying Gronwall's Lemma to this last differential equation we get 

m 

hfeiio. < !i5^«.,fc/;(£)5xfc + aiii. (8.18) 

4=1 

Since ||wfe||oo < N and ||wa;||i -^ 0, we also find that ||i'fe||2 — > 0. Applying the Cauchy-Schwartz 
inequahty to ([STTB)) . from ((5T7)) we get (ii). 

D 
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